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Abstract 

The usual development of the continuous time random walk (CTRW) assumes that jumps and 
time intervals are a two-dimensional set of independent and identically distributed random vari- 



Qh, ables. In this paper we address the theoretical setting of non-independent CTRW's where consec- 

' utive jumps and/or time intervals are correlated. An exact solution to the problem is obtained for 

CN ■ the special but relevant case in which the correlation solely depends on the signs of consecutive 

jumps. Even in this simple case some interesting features arise such as transitions from unimodal 
to bimodal distributions due to correlation. We also develop the necessary analytical techniques 



' and approximations to handle more general situations that can appear in practice. 
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I. INTRODUCTION 



For more than four decades, since their introduction in 1965 by MontroU and Weiss 
continuous time random walks (CTRW's) have been applied to virtually any field in which 
one wishes to provide a dynamical description on the microstructure of a given random 
system. A huge number of examples and applications can be found in the literature, of 
which we only cite a handful: transport in disordered media js, Q], random networks {4], 



self-organized criticality 

[9I, 1^ , time-series analysis [uJ, |l2|] and finance |l3 



, electron tunneling JQ 

rin 




earthquake mode 



mg 



19 



7 

20 



81, hydrology 
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The CTRW generalizes the ordinary random walk since in the latter the steps of the 
random walker are made at equal intervals of time, while in the CTRW the interval between 
steps is a continuous random variable. In this sense CTRW is related to several other ex- 



tensions o 
processes 



: random walks in continuous time, like semi-Markov processes or Markov renewal 
22|, although the seeds of this idea can be traced back to the 1920 's with the pure 



birth Poisson process 23l. \24\. 

A great number of developments of the CTRW are based on the assumption that the mag- 
nitude of the steps (or jumps) and the time intervals between them (also called sojourns) are 
a two-dimensional set of independent and identically distributed random variables. While in 
many cases this is a convenient assumption which allows for simple developments, there are 
some other cases in which independent walks are clearly insufficient to explain some aspects 
of the physical reality, and correlations between consecutive step sizes and/or waiting times 
must be considered. We have met with such a case in our study of financial time series re- 

n 

garding their extreme time statistics 25| where jump magnitudes (transaction-to-transaction 
returns) show short-range memory, but it seems to be also relevant in earthquake modelling, 
where some evidences pointing to the presence of cross-correlations between simultaneous 



26|. Suc- 



and sequential earthquake magnitudes and recurrence times have been reported 
cessive recurrence times appear to be positively self-correlated as well but, oddly enough, 
consecutive magnitudes seems to be independent in this case. 

Our goal in this paper is to address the theoretical setting of non-independent CTRWs, 
a class of random walks that can account for many physical situations. In this kind of walks 
jumps and sojourns are no longer independent random variables and their value at a given 
step may depend on previous steps. We develop the formalism for the Markovian case in 
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which the magnitudes of a given jump and time interval only depend on the preceding step. 
We also obtain a complete solution to the problem when the correlation between consecutive 
steps solely depend on the sign of the previous jump (that is, whether the previous jumps 
is increasing or decreasing but not on its magnitude). Particular examples corresponding 
to this solvable case allow us to visualize and quantify some interesting consequences of the 
existence of correlations between steps as, for instance, the transitions from unimodal to 
bimodal distributions. Finally, we also develop the necessary perturbation techniques to 
deal with more general situations. 

The paper is organized as follows: in Sect. [Ill we outline the traditional CTRW based on 
the assumption of independence between events. In Sect. IIIII we present the general setting 
for non-independent CTRW's that are still amenable to analytical treatment. In Sect. II VI we 
present an exact solution to the problem. Section |V] is devoted to consider weak dependent 
models for which we develop a complete perturbation technique. Conclusions are drawn in 
Sect. I VI I Although this work is essentially technical some even more technical aspects are 
in an Appendix. 

II. THE INDEPENDENT CTRW 

Suppose that a given random process X{t) evolves following a CTRW. In this picture 
any realization of X{t) consists of a series of step functions and X{t) changes at random 
times ■ ■ ■ , t_2, t_i,to, ti, ^2, ■ ' ' while it remains fixed in place between successive steps. The 
interval between these successive steps is a random variable At„ = tn — tn-i which we call 
sojourn or waiting time. At the conclusion of the nth sojourn X{t) experiences a random 
change, or jump, given by 

AXn = AX„(At„) = X(tn) — X(tn-l) = Xn — Xn-1- 

In the usual model of the CTRW waiting times At„ and random jumps AX„ constitute a 
two-dimensional set of identically distributed random variables, (AX„, A)f:„), described by 
the corresponding joint probability density function (pdf) p(^,t), 

T)d^dT = Prob{^ < AX„ < ^ + d^;T < At„, < r + dr}. 
As usual, two marginal pdf's can be derived from p{^, r): 

hiOd^ = Prob{e < AX„ < e + dO, (1) 
3 



and 

il){T)dT = Prob{r < At„ < r + dr}, 
just by integrating over the opposite variable: 

/•oo /»oo 



In this set-up, each pair of random variables (AX„, Atn) is independent of any other pair 
{AXm, Atn,,), m 7^ n, but it is still allowed any degree of correlation between AXn and AjL 



themselves 311] • Some CTRW processes belonging to this category can be found in 
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2l[ | for instance, and sometimes are also named as non-independent models 19| , since 



13, 
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the label independent is then reserved for the particular case in which AXn and Atn are 
also mutually independent random variables, i.e. when 



p(e,r) = MO^(r). 



(2) 



This divergence in the existing notation may therefore induce to misinterpretation. We 
prefer to call Eq. (I2l) the fully-independent CTRW, and keep the term independent CTRW 
for any memoryless process with arbitrary joint pdf. 

The chief objective of the CTRW formalism is to obtain the probability density function 
of X(t). This pdf, called the propagator, is defined by 

p{x, t)dx = Prob{x < X{t) <x + dx\X{to) = 0}, 

where in what follows we shall assume that the initial jump occurred at to = 0. As is well 



known the propagator obeys the following renewal equation 



18| 



p{x,t) = po{x,t) 



/ dt' / p{x — X ,t — t')p{x , t')dx'. 

Jo J -oo 



(3) 



The function p^i^x^t) is the propagator prior the first jump and, since the trajectories of 
X{t) consist in series of step functions, we write 



Po{x,t) = '^{t)S{x), 



where is the probability that no transaction has occurred before time t 



^(t) = I ^{t')dt'. 



(4) 



(5) 
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We can solve Eq. (jH)) in terms of the joint Fourier- Laplace transform: 



poo poo 
Jo J~oo 



The solution is 



p{uj,s) = - -, 6 

1- p{uj,s) 

where pq{u,s) and p{uj,s) are the joint Fourier-Laplace transforms of the functions po{x,t) 
and p{x,t). We easily see from Eqs. (!l!)-(l5l) that the exphcit form of po{uj, s) is 

Po{uj,s) = , 

s 

where ip{s) is the Laplace transform of the pausing-time density '?/'(r). 

III. A GENERAL NON-INDEPENDENT WALK 

As we have explained, the CTRW outlined in the preceding section relies on the assump- 
tion that the pairs (AX„, Atn) are independent two-dimensional random variables. However, 
as we have mentioned in Sect. [T] there are many situations in which the assumption of inde- 
pendence may be doubtful 25|, |26| . We shall thus generalize the CTRW formalism in order 
to account for memory effects due to correlations between different sojourns and/or jump 
increments. 

Among the many ways of doing this extension we choose a simple, but yet gen- 
eral, method which consists in assuming that the joint density of k consecutive changes, 
Tn] Tn-i, ■ ■ ■ ] ^n-k, Tn-k), fulfills the Markov property: 

fc-i 

pi^^ni Till Cn— 1) Tii—\i ' ' ' ■, ^n—ki Tn—k^ pi^^n—mi 'Tn—m\^n—m—ii ^n— m— l) ' pi^^n—ki Tn—k^i 

m=0 

where 

p{i\r'\i,T)di'dr' = Prob{r < AX„ < + de'; 

t' < At^ <t' + dr' \AXn-i = e; At„_i = r}. (7) 

This means that the pair (AX„, At„) depends on all the previous transitions only through 
the immediately preceding one (AX„_i, Ai(:„_i). In an analogous way to the independent 
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walk described by Eq. ([S]), the integral equation governing the evolution of the return pdf 
is given in this case by the renewal equation 



/oo rt 
dx / p{x ,t'\^,T)p{x — x\t — t'\x' ,t')dt' , (8) 
■oo Jo 

where po{x, r) is the propagator prior the first jump and similarly to Eq. ^ we write 

Po{x,t\i,T)=5{x)^>{t\i,T), (9) 

where ^(i|^,r) is the cumulative distribution of the waiting time and it is related to the 
transition density p(x',t'|^,r) by 

/■oo /-oo 

^{t%T)= / dt' / p{x\t'\i,T)dx'. (10) 
Jt J -oo 

Observe that in this case the process X{t) is not Markovian because its pdf p(x,t|^,r) 
depends on both the magnitude of the previous jump ^ = Xq — X_i and its sojourn time 
T = — in other words, the probability distribution of the process at a given time 
depends on two previous times to ^^nd We should note at this point that even the 
independent CTRW is, in general, a non-Markovian process. The only case in which the 
independent CTRW is Markovian is when it is a fully-independent CTRW, and the set of 
random times ■ ■ ■ ,to,^i,^2, • • • is Poissonian, that is, when the pausing time density 'tpij) 
obeys the exponential law j^: 

^(r) = Ae"^", (A > 0). 

Let us remark that the dependent CTRW outlined above is always non-Markovian even for 
this Poissonian density. 

We also note that in the case of independent increments discussed in Sect. [Ill we have 



p{x',t'\i,T)= p{x',t'), 



and Eq. ([H]) reduces to Eq. 

The integral equation given in Eq. ([H]) is the general equation that governs the evolution 
of the random process X{t) and it must be solved if we want to obtain the propagator for 
this non-independent case. Contrary to the independent case, Eq. (JHl) cannot be solved. 
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for any form of the joint density p by means of transform methods. Indeed, the Laplace 
transform with respect to t of Eq. ([H]) is 



POO nt POO 

+ / dte^'^ dt' p{x',t'\^,T)p{x - x',t-t'\x\t')dx', 

Jo Jo J -oo 

where the hat over p and po denotes the time Laplace transform. Note that 

/•oo ft fOO fOO 

/ dte-'' / dt'---= / dt'e-''' / dt"e-''" ■ ■ ■ , 
JO Jo Jo Jo 

where we have exchanged the order of integration and performed the change of variables 
t" = t-t'. Then 

p{x,s\^,t) = po{x,s\^,t) 

POO POO 

+ / dt'e"'*' / p{x',t'\^,T)p{x - x',s\x',t')dx'. 

Jo J -oo 

Finally, the Fourier transform with respect to x of this equation yields 

p{uj,s\i,T) = Po{uj,s\^,t) 

POO POO 

+ / dt'e-''' / e*""'p(x',t'|^,r)p(cu,s|x',t')(^a;', (11) 

Jo J -oo 

which is the farthest we can go without specifying r). 

IV. A SOLVABLE CASE 

The integral equation ( fTTl) cannot be solved for any arbitrary form of p. However, for 
the independent case in which p(x',t'|^,r) = p{x',t') and p{uj, s\x' ,t') = p{uj,s) we recover 
from Eq. ffTTl) the solution given by Eq. Another case in which the level of difficulty is 
somewhat reduced is when waiting times and jumps are not related to each other. In such 
a case the joint density factorizes as: 

p(x',t'|e,r) = ^(t'|e,r)/i(x'|e,r). 

We will also assume the further simplification 

p{x',t'\^,T) = ^{t')h{x'\0, (12) 
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in which correlations between consecutive waiting times have been neglected and we have 
also assumed that the waiting time pdf, ip{t'), does not depend on the magnitude of the 
umps; a situation that, as mentioned above, has been detected in some financial time series 



25|. 



The renewal equation for the propagator of X{t) now reduces to (cf. Eqs. (EI)-©) 

pt poo 

p{x,t\^) = 5{x)^{t) + / dt'ij{t') / h{x'\^)p{x- x',t-t'\x\t')dx'. 

Jo J -oo 

The (time) Laplace transform of this equation yields 

/oo 
h[x\S,)p{x — X , s\x)dx , (13) 
-oo 

where, in terms of the density ip{s), the waiting time distribution function \^(s) can be 
written as 

s 

Let us now suppose that the conditional jump density /i(x'|^) has the form 

h{x'\0 = h{x')[l + eg{x'\i)l (14) 

where e is an arbitrary parameter and h{x') is the unconditional jump density — cf. Eq. ([T]) — 
that is related to h{x'\^) by the constraint 

/oo 
Kx'\mi)di. (15) 
-oo 

Note that this constraint impedes us to consider arbitrary functional forms for h{x'\^) and 
h{x'). For instance, if we set h{x'\^) = [Six' — A^) + 6{x' + A^)]/2, A 7^ 1, as in the case of the 
random walker with shrinking step sizes 27|], Eq. ( fT5l) implies h{x') = 6{x'). The distinctive 
point here is that, unlike geometric random walks, our (unconditional) pdf of AX„ does not 
depend on n. 

Function g{x'\C,) represents the correlation between previous and current jumps and e 
governs its strength. Note that in order to meet Eq. 0151) together with normalization, 

/oo 
h{x'\^)dx' = 1, for all ^, 
-00 

the correlation g{x'\^) must satisfy (see next section for a general discussion on this issue) 

/oo 
■00 
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With the form of h{x'\C,) given in Eq. fll4l) the integral equation for the propagator, Eq. 
ffT^ . reads 



p{x, s\$,) = S{x)'^{s) + tp{s) / h{x')[l + eg{x'\$,)]p{x — x' , s\x')dx' . (16) 
We will solve this equation for any even jump density 

h{x') = h{-x') (17) 
and when the correlation function has the following form 

^(^'1^) = = sgn(x')sgn(0, (18) 

meaning that the dependence between current and previous jumps is only through their 
signs. In other words, the correlation depends on whether consecutive jumps are increasing 
or decreasing but not on their magnitude. From Eq. (HM we see that in this case, since 
h{x'\C,) must be positive definite, ^1 < e < 1. In fact, this model might be interpreted 
as the simplest persistent CTRW [3], in which the probability that the process does not 
change its direction of movement is equal to (1 + e)/2, but where neither jumps nor sojourns 



3 



in order to 



are affected by this persistence. This is the kind of memory we adopted in 
model the observed anti-correlation, with origin in the bid/ask bounce effect: tick-by-tick 
price changes tend two oscillate back and forth between to values due to the bid/ask spread. 

Let us note that the functional form of g{x'\C,) given in Eq. (fTSl) implies that any depen- 
dence on ^ is only through sgn(^) = ^/|^|. Thus p{x,t\C,) = p{x,t\sgn.{^)) which allows us to 
write 

p{x, t\o = (x, t)e(o + p(-) (x, t)e(-o, (19) 

where is the Heaviside step function. The substitution of Eq. (fT9l) into Eq. (fT6l) yields 
for p^'^^x, s) the following set of coupled integral equations 

POO 

s) = 5(x)^(s) + {l + e)'ip{s) / h{x')p^^\x - x',s)dx' 







-|- {1 — e)ijj{s) I h{x')p^ \x — x',s)dx' 



p^ \x, s) = 5{x)'^{s) + (1 — e)'?/'(s) / h{x')p^^\x — x' , s)dx' 



+ (l + e)^(s) / h{x')p^~\x - x' , s)dx' . 







oo 



Now the Fourier transform with respect to x turns this set into a system of algebraic equa- 
tions: 



= ^(s) {l + t)H{uj)p^+\u},s) + {l-t)H{-uj)p^-\uj,s) , (20) 
p'^-\u, s) = ^(s) + ij{s) [(1 - e)H{uj)p'^+\uj, s) + (1 + e)H{-uj)p^~\u, s)] , (21) 

where 

POO 

H{uj) = / e''^'''h{x')dx' 
Jo 

is the "half" Fourier transform of h{x). Obviously 

h{uj)=H{uj)+H{-io), (22) 

where h{uj) is the "complete" Fourier transform of h{x). We note that in writing Eqs. 
(l20l) -( |2T]) and Eq. ( |22l) we have imposed the symmetry of h{x) assumed in Eq. (JTTll . 
Solving for Eqs. (l20 i) -( l2Ti) we have 

p^^\u,s) = l-24ismT^) ^ (23) 

l-{l + e)^{s)h{uj)+Ae^^{s)\H{u)\^ 

where we have used the fact that for real jump densities h{x) the following identity 
H{uj)H{—uj) = \H{u!)\'^ holds. The final solution to the problem is thus given by the 
combination of Eqs. (fT9|) and (!23|) . Therefore, under the assumptions given in Eqs. (fT2|) 
and ffT^ and the special form of the correlation given in Eq. ffT^ . we have been able to 
obtain an exact expression for the Fourier-Laplace transform of the propagator valid for any 
forms of the waiting time density ipi'^) jump density h{C,), provided that the latter is 
an even function of C, with no bias. 

Another interesting quantity is the unconditional propagator p{x, t) defined by 

/oo 
pix,t\OhiOd^. 
-oo 

In the analyzed case in which p{x,t\^) can be decomposed as in Eq. ( |T9l) we have 

p{x, t) = ^ [pW (x, t) + p(-) (x, t)] . (24) 

From Eqs. (^^ and we get 

-/ N 1 — e'i}j(s)h(uj) - , , 

p{uj, s) = . ^ ^ { . ^ s . (25 
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Note incidentally that when e = this expression reduces to 

p{uj, s) = , 

which agrees with the solution of the independent case discussed in Sect. [Tll (cf. Eq. ([6])). 

Aside from the unconditional pdf p{x,t), which provides maximal information about the 
evolution of X{t), there is another quantity of considerable practical interest: the (uncon- 
ditional) variance of X{t). This quantity has the advantage that it does not require the 
knowledge of the entire jump distribution h{C,). It suffices to know the pdf ^^{t) and the 
following two moments of h{^): 

/oo roo 
\mod(, and fi2= enm. 
-oo J — oo 

Let (X^(t)) be the unconditional second moment of the process: 



f oo 

(X^(t)) = / x^p{x,t)dx, 

J — oo 

and let us denote by m2{s) its Laplace transform 

POO 

m2(s) = / e-''{X\t))dt. 



This can be written in terms of the joint Fourier-Laplace transform of p{x, t) by 

A.W^-^ . (26) 

Recall that a direct consequence of the unbiased assumption expressed in Eq. (1171) is that 
the odd moments of h{^) are equal to zero. This implies that all odd moments of process 
X{t) vanish as well; in particular this means that the variance of X{t) coincides with its 
second moment. The combination of Eqs. ([2S]) and fl2Bl) leads, after some manipulations, to 
the relation 

= + M ."^'W . . (27) 

Let us return to the propagator and particularize to the case of Poissonian waiting times 
for which ?/'(r) = Ae"'^'^ and 

^(.) = _A_. = (28) 



Now Eq. (EHD reads 



p(uj, s) = ^ = , (29) 

11 



whose inverse Laplace transform yields the unconditional characteristic function 28 1 



p{uj,t) 



-Xt[l-{l+e)h{ui)/2] 



cosh[Xtk{cu)/2] 



(30) 



where 



k{uj) = ■\/(l + e)2/i2(cj) - 16e\H{uj)\^. (31) 

As to the second moment is concern Eq. ( 1271) can be inverted at once with the result 

2/i?e 



{X\t)) = fi2Xt + 



[A(l - e)t + e-^(i-^)* - 1] 



(32) 



(l-e)2 

Observe that in the independent case (e = 0) the variance shows an ordinary diffusion 
behavior while correlations introduce a richer dynamics. 

In order to invert Eq. ( l30i) and thus obtaining an expression for the propagator p{x, t) 
we must chose a functional form for the jump density h{^). We will select the two-sided 
exponential density, 

MO = (7/2)e-^l^l, 

for two main reasons. On the one hand it can be of interest in finance, the field that 
motivates this work in the first instance. Even though it is well established that pdf's of 
financial returns show a power-law decay [29|, there are an increasing number of evidences 
pointing to the fact that small and moderate returns are better described through a Laplace 
law — see 30[ and references therein. On the other hand, one of the main motivations of 
this sections is the introduction and subsequent analysis of a case for which we can obtain 
closed expressions. It is clear from Eq. (l30l) that when the characteristic function of h{^) is 
intricate this goal will be well out of reach. In our case h{uj) is the inverse of a polynomial: 

7/2 



h{uj) 



7 

72 + ci;2 



^ — lUJ 



(33) 



We incidentally note that now the variance of the process is given by Eq. ( l32i) where 
Hi = 1/7 and H2 = 2/7^. When < e < 1 one can show that the Fourier inversion of Eq. 



reads 



32| 



p{x,t) 



-xt 



5{x) + 



76 



-xt 



2\/e Jx^\x\^ V"" 



1/2 



-{l+e)u/2X€ 



Xe 



1/2 



2Xe 



eX^'y^\x 



Ii{2Vut) 



(34) 
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(0 < e < 1), where In{z) are modified Bessel functions. Altliougli tlie case e = 1 is contained 
in Eq. flMl) it can be written more explicitly as 



p{x,t) = e-^'6{x) + iJ^Ji (2V^^) e-^*-^l^l. (35) 



7 

The recovery of the independent case e = from Eq. ( IMl) is a delicate issue that deserves a 
special treatment. In this case one has 



p(x,t)=e-^*5(x)+7f-] u'^'^'^iVd'u^ ' ^ ^ 



(e = 0). 

We can now graphically explore some of the most relevant properties of the unconditional 
propagator in the analyzed example. However, as we will show, our example will share those 
traits with any process that presents Poissonian waiting times, i.e. for which Eq. ( l32l) stands. 
In Fig. [T] we plot the regular part of the probability density function (in 7 units) for different 
values of e. In particular we present the cases of (i) a strong anti-correlated process (e close 
to —1), Fig. [Ha; (ii) a weak anti-correlated process. Fig. [Hb; (iii) the independent case 
(e = 0), Fig. [He; (iv) a weak correlated process. Fig. [Hd; (v) a strong correlated process (e 
close to 1), Fig. [He; and finally, (vi) the completely persistent case (e = 1), Fig. [Hf. The 
visible effect of anti-persistent memory in the process is that the probability density function 
becomes narrower around x = 0. Thus, for larger negative values of e, the system tends 
to remain longer near the origin, and the process exhibits sub-diffusive behavior for small 
timescales. In fact, from Eq. fl32l) we will have for At ^ 1 that 



ait) = ^WW) ~ ^J^^2Xt + e^l\H^, 

and therefore the process is sub-diffusive for e < 0, diffusive in the independent case (recall 
that this statement is valid for all timescales), and super- diffusive when e > 0. 

For large positive values of the correlation parameter e, see Fig. [He and Fig. [Hf, the 
unconditional propagator presents another interesting property: there are two modes in the 
probability density function. These two modes are located in the vicinity of the conditional 
first moments (X^'^^t)), 

/oo 
xp^^\x,t)dx = ±fii—- \1 - e~^(i-^)*l , 



13 



E=-o.a 



e=-0.2 



Probability density 



Probability density 



(a) 



0.35 r 

0.30 - 

0.25 - 

0.20 - 

0.15 - 

0.10 - 
0.05 

0.00 J* 
0^ 



'10 
'-5 " TX 



(b) 



0.30 r 

0.25 - 

0.20 - 

0.15 

0.10 

0.05 

0.00 





Probability density 



Probability density 



(c) 



0.30 
0.25 
0.20 
0.1E 
0.10 
O.OE 
0.00 




10-2" 



(d) 



0.25 r 

0.20 - 
0.15 - 
0.10 
0.05 
0.00 




10-2" 



Probability density 



Probability density 



(e) 



0.16 
0.14 
0.12 
0.10 
0.08 
0.06 
0.04 
0.02 
0.00 



-^15 
10 

yx 



(f) 



0.16 
0.14 
0.12 
0.10 
0.08 
0.06 
0.04 
0.02 
0.00 



FIG. 1: Probability density function for different degrees of correlation. We can see how the 
negative correlated processes concentrate the probability around the origin, whereas the positive 
correlated processes spread faster. Within this context, if the correlation is large enough, the 
system shows a transient bimodality. 



and become more and more notorious for increasing values of e, as we show in Fig. Oa. 
However, this apparent bimodality must disappear for large timescales, since if At ^ 1 we 
have [33(1 



ait) 



1^2 + 



2 file 



At, 



14 



whenever e 7^ 1. This means that we must eventually attain to diffusive limit, as it is 
depicted in Fig. [21b. Only in the completely persistent case (e = 1) the phenomenon is not 
of transient nature, because in this case the process is super-diffusive at all timescales: 
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FIG. 2: (Color online) The role of e and t in the bimodality of the probability density function. In 
(a) we can see how bimodality becomes more evident for larger values of e. In (b) we can check how 
this feature finally disappears even in a strongly correlated process. We have used the standard 
deviation of the process, cr{t), in order to make the plots commensurable. 





x/o 



V. A WEAKLY DEPENDENT MODEL 

Obtaining exact expressions for the propagator is usually quite involved, not to say im- 
possible, in many practical situations and we have to resort to approximations based on 
perturbation solutions of the integral equation (IHl). With this purpose in mind we will work 
with the following form of the joint density that generalizes the jump density given in Eq. 

p{x', t'\^, t) = p{x', t') [1 + eg{x', t'\^, r)], (37) 
where p{x^t) is the unconditional joint density satisfying 

POO poo 

pix',t')= dr p{x\t'\i,T)p{i,T)di, (38) 

Jo J -00 

and the function g{x' ,t'\C,,T) indicates the correlations between the waiting time and the 
jump of the current sojourn and those of the preceding sojourn, e is a parameter measuring 
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the strength of this correlation. In what follows we will suppose that e is small, i.e., the 
model is weakly dependent. Function g is not arbitrary and must satisfy two consistency 
conditions. Indeed, from the normalization of the densities p{x' ,t'\^,T) and p{x',t'): 



p{x , if: )dx = 1, 



/•OO /"OO /»oo /»c 

/ dt' / p{x' ,t'\^,T)dx' = / dt' 

Jo J -OO Jo J ~i 

immediately follows that 

poo poo 

/ dt' / p{x' ,t')g{x' ,t'\^,T)dx' = 0. (39) 

Jo J-oo 

On the other hand, plugging Eq. (|371) into Eq. ( |38l) and taking again into account normal- 
ization we get 

poo poo 

/ dr pi^,r)gix',t'\^,T)d^ = 0. (40) 

Jo J-oo 

We also observe that if p{x' ,t')g{x' ,t'\C,,T) and p{C,,T)g{x' ,t'\^,T) are integrable functions 
with respect to t' and r respectively, then for consistency conditions, Eqs. fl39l) - fl4UI) . to hold 
it suffices that: 

/OO poo 
pix', t')gix', t'le, r)dx = / gix', t'\^, r)p(e, T)d^ = 0. (41) 
-OO J —OO 

The starting point of our analysis is the renewal equation for the joint Fourier-Laplace 
transform of the propagator p{lj, r). Substituting then Eq. (1371) into Eq. (fTTll we have 

P(t^,s|^,r) = po{uj,s\^,t) 

poo poo 

+ / dt'e-''' / e^"^''p(a;',t')[l + e^(a;',i'|^,T)]p(cj,s|a;',t')f^a;'. (42) 

Jo J-oo 

Assuming that e is small we look for a solution to this equation in the form 

OO 

p{uj, s\^, t) = q{uj, s) + J2 ^1^, r). (43) 

n=l 

In order to proceed further we need to know the dependence on e of the propagator prior 
the first sojourn. From Eqs. flU|)- ffTU|) and Eq. flH7|) we write 



OO POO 



Po{x,t\^,T) = 6{x) I dt' I p{x',t')[l + eg{x',t'\^,T)]dx', 

but 



OO POO 



dt' / p{x',t')dx' = ^(t) 
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and using the consistency condition fHTl) we finally get 



(44) 



hence po is independent of e. 

One can easily see by substituting Eqs. ( H3l) and (jHj) into Eq. ( H2l) that the zeroth-order 
s) corresponds to the independent case 

q{uJ,s) = 

1- p{uj,s) 

while for = 1, 2, 3, ■ ■ ■ we have the recursive integral equations: 



(n-l). 



+ / dt'e 
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''pix',t')p^''\uj,s\x',t')dx', 



(45) 



where 

g("-i)(^,s|e,r) 

and 



OO /"OO 

l—St' I JlJJX'/ I ±l\„/l J./ 



(it e 



e^-^Xx', t')^?(a;', t'le, r)p("^^)(u;, s\x\ t')dx' , (46) 



Q(o)(^,s|e,r) = g>,s) / rft'e"^*' / e^'^^'p(x', t')^7(a:', t'l^, r)f/x' (47) 

JO J-oc 

In the Appendix [X] we show that the solution to Eq. 



is given by the recursive 



expression (ra = 1, 2, 3, ■ ■ ■ ) 

p(")(a;,.|e,r) 



OO POO 



dt e 



e*""p(x',t') 



OO 

' J./ 1 



g{x\t'\^,T) 



G{x',t'\uj,s) 



where 



and 



1 - p{uj,s) 

G{x',t'\uj,s) = 

p^^\ijj, s\x\ t') = q{uj, s) 



p'^''''^\u,s\x',t')dx', 



OO /-OO 

J~oo 



e'-ypiy,T)gix',t'\^,T)d^, 
1 - p{uj,s)' 



(48) 



(49) 



For n = 1 we have 



/•OO /"OO 

p«(o;,s|e,r) = g>,s) / rftV^*' / e^-^''p(^', f) 

Jo J-oo 



^(a;',tle,r) 



+ 



1 — p(ti;, s 



-G(x', t'luj, s) 



dx' 
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which, after defining 
and (cf. Eq. (jl9|)) 



can be written as 

p«(o.,s|e,r) 



dt'e 



e--' p{x\t')g{x\t'\i,T)dx' 



(50) 



dt e 



I ~st' 



e''^'''p{x',t')G{x\t'\uj,s)dx', 



(51) 



1 



-Gp(u;,s) 



g(oj,s) 



Therefore, the joint Fourier-Laplace transform of the propagator up to first order in e is 



1 + e 



1- p{uj,s) 



(52) 



From the above expression of the conditional propagator we can also get the unconditional 
propagator defined by 



p{x,t) 



oo roc 

dr / p{^,T)p{x,t\^,T)dC 

J —oo 



(53) 



From Eq. (1521) and taking into account the normalization of p{^, r) we have 



p{uj,s) 



1 + e 



noo poo 
Jo J-oo ^ 



Gp{uj, s) 



- p{uj,s) 

But from Eqs. (HUl) and (l^nil one can easily see that 

/*00 /"OO 

/ dr p{^,T)gp{uj,s\^,T)d^ = 0. 

Jo J-oo 



1 -P(^,s)' 



Hence 



p(u;,s) 



*(s) 



1 -p(^,s) 



(54) 



1 -p(t^,s) 

We will finally present an instrumental example of the use of the perturbation technique 
just developed. We assume, as in Sect. HV] that the joint density p factorizes as (cf. Eqs. 
(E]) and (HI])) 

p{x',t'\^,T)=ij{t')h{x')[l + eg{x'\0], (55) 

where |e| <^ 1 and h{^) is an even function of ^. Contrary to the solvable case discussed in 
Sect. IIVI in which the correlation g{x'\^) depends solely on the signs of consecutive jumps 
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(cf. Eq. (ITS|1). we now assume that the correlation depends also on jump sizes. We thus 
suppose 

g{x'\0 = sgn(x')e-''(l"'l+l«l)sgn(0, (56) 

(a > 0). With this correlation we will evaluate the expressions for the propagators p{x,t\^) 
and p{x, t) as given respectively by Eqs. ( !52|) and ( !54l) for their joint Fourier-Laplace trans- 
form up to first order in e. To this end we need the explicit expressions for the auxiliary 
quantities QpioJ, s\^) and Gp{uj, s) which appear in Eqs. ( l52i) and ( 15^ . 

Using Eqs. fl55|) and fl56l) . the expression for gp{uj, s\C,) defined in Eq. fl50l) can be written 

as 

/oo 
sgn(a:')e^'^^'-'^I^U(x')cix'. 
■oo 

But taking into account the symmetry of h{x') expressed by Eq. ffT7|) we can write 

/oo poo 
sgn(x')e^'"^''-"l^'l/i(a;')rfx' = 2i / e-"^'/i(x') sintua;'cix'. 
■oo Jo 

Hence 

s|0 = 2t^{syK{uj, a)e-'^l«lsgn(0, (57) 

where 

/■oo 

hs{uj,a)= / e~''^'/i(a;') sina;a;'(ia;' (58) 
Jo 

is the Fourier sine transform of e~"'^'h{x'). 

Proceeding in an analogous way we see that the expression for Gpiu, s) defined in Eq. 
f lSTj) is given by 

" noo "I 2 

Gp{uj,s) = i}^{s) / sgn(x')/i(x')e*'^^'-'^l^'ldx' . 

_J — oo 

But as we have just seen (cf. Eq. ( l58l) ) 

/oo 
sgn(x')/i(x)e'""'-''l"'lrfx = 2ih,{uj,a)] 
■oo 

whence 

G,(^,s) = -4^2(^)^2^^^^)^ (59) 
Substituting Eqs. (ETj) and ([59]) into Eq. ([52]) yields 

2ie-''l«lsgn(0 



l-i){s)h{uj) 
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1 - V^(s)/i(cj) 



For Poissonian sojourns (cf. Eq. (1281) ) we can take the inverse Laplace transform of this 
expression which yields the conditional characteristic function: 



p{u,t\0 = e-^*[i-^(-)]+e<'2z\^^'''^ 



h{iu) 



,-\t g-At[l-/i(a;)] 



e-'^l«lsgn(0 

e-^* + [Xthiuj) - iJe-^'Ii-'^H] \ + 0(e2). (60) 



L h{iu) 

The unconditional characteristic function can be analogously obtained through Eqs. (E 
and ( l59l) or else directly by substituting Eq. (!6Ql) into 



by either way one chooses the final result is 



hs{uj,a) 



L h{uj) 

For this example the variance of the process, (X^(t)) = —d'^p{uj, s) / duj'^\uj=o, is easily seen 
to be 

{X\t)) = Xtp2 + Senlie"^' + Xt - 1), 

where 

fi2 = —h"{0) and Ka = h'^{0,a). 



VI. SUMMARY AND CONCLUSIONS 



We have presented a generalization of the CTRW which include correlations between 
consecutive sojourns and jumps. We have derived the general equations governing the 
time evolution of the dependent walk and we have exactly solved them in some particular 
instances. We have also developed a general perturbation technique aimed to treat, within 
any desired degree of accuracy, weakly dependent models. That is, those models in which 
there is a low correlation between consecutive events. 

Due to the extensive analytical apparatus and technical aspects contained in this pa- 
per, which may obscure the main objective and perhaps discourage potential users of the 
technique presented, we shall now summarize the key expressions of our development. 

The model is based on a two-dimensional Markov series of jumps and sojourns, with a 
conditional joint density p{C ^t'I^^''') defined in Eq. ([7]). The main objective of CTRW is 
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obtaining the so-called propagator t|^,r), that is, the (conditional) probability density 
function of the process X{t), provided we know the value of the last jump size, ^, and waiting 
time, r. The propagator obeys a renewal equation (cf. Eq. ([8])) and its Fourier-Laplace 
transform satisfies the integral equation ( ITTi) . We have been able to find an exact solution 
to this equation when the joint density has the following form (cf. Eqs. ( JT2l) and ([HI)) 

pie,T%T) = V^(r')/i(r)[l + e sgn(r)sgn(0], (61) 

for which the correlation between jumps depend on whether they are increasing or decreasing 
but not on their magnitude. In such a case the Fourier- Laplace transform of the uncondi- 
tional propagator is given by (cf. Eq. (p5|) ) 

~r \ 1 - eil)is)hiijj) ^ . , 

p{uj,s) = . ^ ^ ^ i r ^ s . 

l-{l + e)^{s)h{uj) + 4e^^{s)\H{uj)\^ 

In the case of Poissonian sojourns and Laplacian jumps we can invert this expression and 

obtain the propagator p{x,t) for different values of e (see Eqs. f l34|) - fl36|) ). From these 

expressions we can see some interesting properties due to the existence of correlations such 

are the transitions from unimodal to bimodal distributions (cf. Fig. [T]and Fig. [21). 

Although we have been able to solve Eq. ([TTl) in the special case provided by Eq. ( [6T1) . a 

general solution to the problem for any form of the joint density p seems to be out of reach. 

However, in many practical situations the degree of dependence between current and past 

events is weak. In such cases it is possible to derive a perturbation technique which allows 

for an approximate solution to the above equation to any desired degree of accuracy. We 

thus write 

where p(^', t') is the unconditional joint density, g{^' ,t'\^,t) indicates correlation and e, 
now a small quantity, measures the strength of such a correlation. The function g is not 
arbitrary and must obeys some consistency conditions (cf. Eq. (1411) ) in order to keep the 
normalization of the p's. 

The propagator can be written in the form of an infinite series 

oo 

p{u, s\^, t) = q{u, s) + Y, e"p(")(^, ^1^, r), 

n=l 

where q{uj, s) is the propagator when no correlation is present, that is, it corresponds to 
the propagator of the independent CTRW and is given by Eq. The rest of terms 
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p^"-\uj, s\^, r) (n = 1, 2, 3, ■ ■ ■ ) obey the integral equation Eq. (H5i) whose solution is given 
by Eq. (I48l) . what allows us to compute s\^, t) if we know s\^, t). Obviously 

by repeating this operation one can obtain p^'^'>(uj, s\y, r) for any n = 1, 2, 3, ■ ■ ■ and, hence, 
an approximate expression for the propagator to any desired degree of accuracy although, 
in many cases, the lowest order n = 1 will suffice. In such a case the explicit expression for 
the propagator is (cf. Eqs. (!50l)-( !52l) ) 



r 



1 + e 



Gp{u, s) 



p{uj,s) 



+ 0(e 




and for the unconditional propagator defined in Eq. (1531) we have 



1 + e 



1- p{u,s) 



0(e' 



1 - p{uj,s)' 



We end this work by recalling that our first motivation to treat the problem of dependent 
CTRW's arose from our work in econophysics. In dealing with extreme time statistics 
of financial time series, in particular with the mean exit times of the process out of a 
given interval, we noticed that the observed behavior cannot be properly described by the 
traditional {i.e., independent) CTRW but one needs some degree of correlation between 



present and past events 



25|. In spite of this specific motive we certainly believe that a 



general development of the dependent CTRW -at least for a Markovian joint density- may 
be of broad interest because the independence assumption in the traditional CTRW is just 
a first approximation for many physical phenomena that are amenable to be studied within 
the CTRW framework . In any case in forthcoming works we will apply it to financial 
time series. 
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APPENDIX A: SOLUTION TO A RECURSIVE INTEGRAL EQUATION 



We will solve the recursive integral equation 



POO POO 

+ / dt'e-''' / e''^'''p{x',t')p^''\u;,s\x',t')dx', (Al) 







where n = 1, 2, 3, ■ ■ ■ . To this end we multiply both sides of Eq. flAip by e ^o-r+«i^oCp(^^^ 
and integrate over ^ and r, we obtain 

where p{uJo, Sq) is the joint Fourier-Laplace transform of p(^, r), 

roc roo 

F(-\u;, sluo, So) ^ / dre-'^^ / e^-««p(e, r)^^"^^, ^1^, r)dC, (A3) 

Jo J-oo 

and 

Jo J-oo 

Setting cuo = ci; and sq = s in Eq. (lA2p we get 

1 - p{uj, s) 

which introduced back to Eq. flA2p yields 

(A5) 



s\u;o, So) = Q^^^-'\u, s\u;o, So) + Q(n~i)(^, ,|^, 

1- p{uj,s) 



From the definition of F^"'\uj , s\uJo, So) given in Eq. flA3p we see that the Fourier-Laplace 
inversion with respect to uo and Sq of this quantity is 

sluo, So) p(e, r)p(")(^, r), 

and a similar expression for the inversion of Q^^~^\uj, s\uJo, sq). Therefore, the inversion of 
Eq. (lASp reads 

r) = g("-^)(^, r) + ^ -,Q^''-'\uj, s\uj, s). (A6) 

1- p{uj,s) 

By combining the definition of Q^'^^^^co, s\uj, s), given in Eq. dAAh when cuq = "-^ and sq = s, 
with that of g("~^)(u;, r) given in Eqs. (Iini)-(11ZD, we write 



oo poo 







Q('^-^)(cu,s|cu,s) = / dt'e-''' e''''''p{x',t')G{x',t'\u;,s)p^''-^\uj,s\x',t')dx' (AT) 
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where 



/'OO poo 
Jo J-oo 

Finally, substituting Eq. fHUj) and Eq. (1A7P into Eq. (1A6P we obtain the recursive solution 



given in Eq. 
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